Why we (usually) don’t have to worry about multiple comparisons
نویسندگان
چکیده
Applied researchers often find themselves making statistical inferences in settings that would seem to require multiple comparisons adjustments. We challenge the Type I error paradigm that underlies these corrections. Moreover we posit that the problem of multiple comparisons can disappear entirely when viewed from a hierarchical Bayesian perspective. We propose building multilevel models in the settings where multiple comparisons arise. Multilevel models perform partial pooling (shifting estimates toward each other), whereas classical procedures typically keep the centers of intervals stationary, adjusting for multiple comparisons by making the intervals wider (or, equivalently, adjusting the p values corresponding to intervals of fixed width). Thus, multilevel models address the multiple comparisons problem and also yield more efficient estimates, especially in settings with low group-level variation, which is where multiple comparisons are a particular concern.
منابع مشابه
Aging, Pensions and Long-term Care: What, Why, Who, How?; Comment on “Financing Long-term Care: Lessons From Japan”
Japan has been aging faster than other industrialized nations, and its experience offers useful lessons to others. Japan has been willing to expand its welfare state with a long-term care (LTC) insurance to finance home care and nursing home care for frail elderly. As Ikegami shows, it created new facilities and expanded specialized staffing for home care, developed a c...
متن کاملSample Size Considerations for Multiple Comparison Procedures in ANOVA
Adequate sample sizes for omnibus ANOVA tests do not necessarily provide sufficient statistical power for post hoc multiple comparisons typically performed following a significant omnibus F test. Results reported support a comparison-of-most-interest approach for sample size determination in ANOVA based on effect sizes for multiple comparisons. Introduction The determination of an appropriate s...
متن کاملبررسی قدرت باورهای فراشناختی معیوب برای پیشبینی نگرشهای ناکارآمد در بیماران قلبی-عروقی سالمند و غیرسالمند
Objectives: This research was conducted with the aim of explaining the dysfunctional attitudes of hospitalized cardiovascular patients through dysfunctional metacognitive beliefs. Methods & Materials: This cross-sectional study was conducted in Shariati Hospital in Isfahan, Iran, in 2012. The statistical population was the hospitalized cardiovascular patients of Shariati Hospital in ...
متن کاملChanging the Conversation, Why We Need to Reframe Corruption as a Public Health Issue; Comment on “We Need to Talk About Corruption in Health Systems”
There has been slow progress with finding practical solutions to health systems corruption, a topic that has long languished in policy-makers “too difficult tray.” Efforts to achieve universal health coverage (UHC) provide a new imperative for addressing the long-standing problem of corruption in health systems making fighting corruption at all levels and in all its for...
متن کامل